2025-07-13 00:57:14,441 [ 51215 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-07-13 00:57:14,441 [ 51215 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2025-07-13 00:57:14,441 [ 51215 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2025-07-13 00:57:14,441 [ 51215 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_orh80l --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_database_delta/test.py::test_complex_table_schema test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_access_control_on_cluster/test.py::test_access_control_on_cluster test_catboost_evaluate/test.py::testAmazonModelManyRows test_distributed_format/test.py::test_remove_replica test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_config_decryption/test_wrong_settings.py::test_invalid_chars test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect [gw7] [ 1%] PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key [gw6] [ 2%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw4] [ 3%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] [gw8] [ 4%] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster [gw6] [ 5%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw8] [ 6%] PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml [gw7] [ 7%] PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes [gw6] [ 8%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw6] [ 9%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw8] [ 10%] PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster [gw4] [ 11%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw0] [ 12%] PASSED test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration [gw0] [ 13%] PASSED test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas [gw2] [ 14%] PASSED test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow [gw0] [ 15%] PASSED test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query [gw6] [ 16%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw2] [ 17%] PASSED test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_default_compression_codec/test.py::test_default_codec_for_compact_parts [gw2] [ 18%] PASSED test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures [gw2] [ 19%] PASSED test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric [gw2] [ 20%] PASSED test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath [gw4] [ 21%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] [gw2] [ 22%] PASSED test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath [gw7] [ 23%] PASSED test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method [gw2] [ 24%] PASSED test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] [gw2] [ 25%] PASSED test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate [gw2] [ 26%] PASSED test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures [gw4] [ 27%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] [gw8] [ 28%] PASSED test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple [gw2] [ 29%] PASSED test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures [gw2] [ 30%] PASSED test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures [gw2] [ 31%] PASSED test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash [gw5] [ 32%] PASSED test_distributed_format/test.py::test_remove_replica test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] [gw7] [ 33%] PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method test_dictionaries_dependency_xml/test.py::test_dependent_tables [gw0] [ 34%] PASSED test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries [gw1] [ 35%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes [gw8] [ 36%] PASSED test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node [gw0] [ 37%] PASSED test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl [gw3] [ 38%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] [gw0] [ 39%] PASSED test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load [gw0] [ 40%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key [gw0] [ 41%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key [gw0] [ 42%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema [gw0] [ 43%] PASSED test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration [gw0] [ 44%] PASSED test_dictionaries_postgresql/test.py::test_predefined_connection_configuration [gw4] [ 45%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] [gw6] [ 46%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw2] [ 47%] PASSED test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_create_query_constraints/test.py::test_create_query_const_constraints [gw6] [ 48%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw2] [ 49%] PASSED test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments [gw5] [ 50%] PASSED test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] [gw2] [ 51%] PASSED test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_backup_restore_keeper_map/test.py::test_on_cluster[0] [gw4] [ 52%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] [gw7] [ 53%] PASSED test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data [gw8] [ 54%] PASSED test_default_compression_codec/test.py::test_default_codec_single [gw0] [ 55%] PASSED test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw1] [ 56%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] [gw0] [ 57%] PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw5] [ 58%] PASSED test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] test_alter_settings_on_cluster/test.py::test_default_database_on_cluster [gw4] [ 59%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] test_backward_compatibility/test_functions.py::test_aggregate_states [gw3] [ 60%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] [gw7] [ 61%] PASSED test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name [gw2] [ 62%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw4] [ 63%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields [gw7] [ 64%] PASSED test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name [gw5] [ 65%] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw0] [ 66%] PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster [gw6] [ 67%] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[0] test_backup_restore_keeper_map/test.py::test_on_cluster[1] test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw5] [ 68%] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] [gw3] [ 69%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] [gw2] [ 70%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw3] [ 71%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] [gw6] [ 72%] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[1] [gw5] [ 73%] PASSED test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] test_always_fetch_merged/test.py::test_replica_always_download [gw4] [ 74%] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields test_async_insert_memory/test.py::test_memory_usage test_config_corresponding_root/test.py::test_work [gw4] [ 75%] PASSED test_config_corresponding_root/test.py::test_work [gw5] [ 76%] PASSED test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] [gw2] [ 77%] PASSED test_always_fetch_merged/test.py::test_replica_always_download [gw3] [ 78%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_distributed_default_database/test.py::test_query [gw1] [ 79%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] [gw2] [ 80%] PASSED test_distributed_default_database/test.py::test_query [gw6] [ 81%] PASSED test_async_insert_memory/test.py::test_memory_usage [gw3] [ 82%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] [gw3] [ 83%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw3] [ 84%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw1] [ 85%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] [gw8] [ 86%] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions [gw8] [ 87%] SKIPPED test_backward_compatibility/test_functions.py::test_string_functions test_config_yaml_full/test.py::test_yaml_full_conf [gw8] [ 88%] PASSED test_config_yaml_full/test.py::test_yaml_full_conf [gw7] [ 89%] PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw1] [ 90%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts [gw7] [ 91%] PASSED test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts [gw1] [ 92%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] [gw1] [ 93%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup [gw1] [ 94%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw1] [ 95%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw0] [ 96%] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption [gw0] [ 97%] PASSED test_broken_part_during_merge/test.py::test_merge_and_part_corruption [gw9] [ 98%] ERROR test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables [gw9] [ 99%] ERROR test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables [gw9] [100%] ERROR test_database_delta/test.py::test_multiple_schemes_tables ==================================== ERRORS ==================================== _________________ ERROR at setup of test_complex_table_schema __________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 11140 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ~~~~~~~~~~~~~~~~~~~~~ Stack of (140118969763392) ~~~~~~~~~~~~~~~~~~~~~ File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 411, in _perform_spawn reply.run() File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 341, in run self._result = func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 1160, in _thread_receiver msg = Message.from_io(io) File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 567, in from_io header = io.read(9) # type 1, channel 4, payload 4 File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 534, in read data = self._read(numbytes - len(buf)) ---------------------------- Captured stderr setup ----------------------------- Command:[docker ps | wc -l] Stdout:1 No running containers Pruning Docker networks Command:[docker network prune --force] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 21087f9bab7e ENV SHLVL 0 ENV HOME /root ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 5ccda723c1fc ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 ENV PYTEST_XDIST_TESTRUNUID 17105263888447cbbe2d367ed9ce0622 ENV PYTEST_XDIST_WORKER gw9 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_database_delta/test.py::test_complex_table_schema (setup) CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestdatabasedelta-gw9. Added instance name:node1 tag:latest base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Running tests in /ClickHouse/tests/integration/test_database_delta/test.py Cluster start called. is_up=False Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for common tests configuration Copy common configuration from helpers Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/database Setup logs dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Failed to start cluster: Timeout >900.0s Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 132, in run_and_check res = subprocess.run( File "/usr/lib/python3.10/subprocess.py", line 505, in run stdout, stderr = process.communicate(input, timeout=timeout) File "/usr/lib/python3.10/subprocess.py", line 1154, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/usr/lib/python3.10/subprocess.py", line 2021, in _communicate ready = selector.select(timeout) File "/usr/lib/python3.10/selectors.py", line 416, in select fd_event_list = self._selector.poll(timeout) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 313, in handler timeout_sigalrm(item, settings) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 498, in timeout_sigalrm pytest.fail("Timeout >%ss" % settings.timeout) File "/usr/local/lib/python3.10/dist-packages/_pytest/outcomes.py", line 198, in fail raise Failed(msg=reason, pytrace=pytrace) Failed: Timeout >900.0s docker compose up was not called. Trying to export docker.log for running containers Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 docker compose up was not called. Trying to export docker.log for running containers Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 ------------------------------ Captured log setup ------------------------------ 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[docker ps | wc -l] (cluster.py:121, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2025-07-13 00:57:20 [ 768 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[docker network prune --force] (cluster.py:121, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] (cluster.py:121, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:145, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV HOSTNAME 21087f9bab7e (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV SHLVL 0 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV HOME /root (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV OLDPWD / (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV TZ Etc/UTC (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV DOCKER_BASE_TAG 5ccda723c1fc (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 17105263888447cbbe2d367ed9ce0622 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PYTEST_XDIST_WORKER gw9 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : ENV PYTEST_CURRENT_TEST test_database_delta/test.py::test_complex_table_schema (setup) (cluster.py:419, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:719, __init__) 2025-07-13 00:57:20 [ 768 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1656, add_instance) 2025-07-13 00:57:20 [ 768 ] DEBUG : Cluster name: project_name:roottestdatabasedelta-gw9. Added instance name:node1 tag:latest base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1942, add_instance) 2025-07-13 00:57:20 [ 768 ] INFO : Starting cluster... (test.py:42, started_cluster) 2025-07-13 00:57:20 [ 768 ] INFO : Running tests in /ClickHouse/tests/integration/test_database_delta/test.py (cluster.py:2672, start) 2025-07-13 00:57:20 [ 768 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-07-13 00:57:20 [ 768 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 00:57:20 [ 768 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 00:57:20 [ 768 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 00:57:20 [ 768 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 00:57:20 [ 768 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 00:57:20 [ 768 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 00:57:20 [ 768 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-13 00:57:20 [ 768 ] DEBUG : Setup directory for instance: node1 (cluster.py:2692, start) 2025-07-13 00:57:20 [ 768 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/configs/config.d (cluster.py:4649, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/database (cluster.py:4666, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/logs (cluster.py:4677, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-13 00:57:20 [ 768 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env (cluster.py:96, _create_env_file) 2025-07-13 00:57:20 [ 768 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-13 00:57:20 [ 768 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-13 00:57:20 [ 768 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-13 00:57:20 [ 768 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-13 00:57:20 [ 768 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-07-13 00:57:20 [ 768 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:02:20 [ 768 ] INFO : Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds (cluster.py:2709, logging_pulling_images) 2025-07-13 01:02:22 [ 768 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:07:22 [ 768 ] INFO : Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds (cluster.py:2709, logging_pulling_images) 2025-07-13 01:07:25 [ 768 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:12:20 [ 768 ] DEBUG : Failed to start cluster: (cluster.py:3091, start) 2025-07-13 01:12:20 [ 768 ] DEBUG : Timeout >900.0s (cluster.py:3092, start) 2025-07-13 01:12:20 [ 768 ] DEBUG : Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 132, in run_and_check res = subprocess.run( File "/usr/lib/python3.10/subprocess.py", line 505, in run stdout, stderr = process.communicate(input, timeout=timeout) File "/usr/lib/python3.10/subprocess.py", line 1154, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/usr/lib/python3.10/subprocess.py", line 2021, in _communicate ready = selector.select(timeout) File "/usr/lib/python3.10/selectors.py", line 416, in select fd_event_list = self._selector.poll(timeout) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 313, in handler timeout_sigalrm(item, settings) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 498, in timeout_sigalrm pytest.fail("Timeout >%ss" % settings.timeout) File "/usr/local/lib/python3.10/dist-packages/_pytest/outcomes.py", line 198, in fail raise Failed(msg=reason, pytrace=pytrace) Failed: Timeout >900.0s (cluster.py:3093, start) 2025-07-13 01:12:20 [ 768 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-13 01:12:20 [ 768 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:12:20 [ 768 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:12:20 [ 768 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:12:20 [ 768 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:12:20 [ 768 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:12:20 [ 768 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:12:20 [ 768 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:12:20 [ 768 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:12:20 [ 768 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:12:20 [ 768 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-13 01:12:21 [ 768 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-13 01:12:21 [ 768 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:12:21 [ 768 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:12:21 [ 768 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:12:21 [ 768 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:12:21 [ 768 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:12:21 [ 768 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) _____________ ERROR at setup of test_embedded_database_and_tables ______________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 11140 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ________________ ERROR at setup of test_multiple_schemes_tables ________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 11140 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ----------------- generated report log file: parallel0_0.jsonl ----------------- ============================== slowest durations =============================== 900.77s setup test_database_delta/test.py::test_complex_table_schema 574.97s setup test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 299.36s setup test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 211.00s setup test_backward_compatibility/test_functions.py::test_aggregate_states 130.42s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 115.64s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 109.72s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 107.39s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 106.89s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 61.97s call test_async_insert_memory/test.py::test_memory_usage 47.46s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 40.86s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 40.11s call test_backward_compatibility/test_functions.py::test_aggregate_states 39.77s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 38.49s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 38.22s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 36.35s call test_backup_restore_keeper_map/test.py::test_on_cluster[1] 36.10s call test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 34.67s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 34.66s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 33.38s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 32.50s call test_backup_restore_keeper_map/test.py::test_on_cluster[0] 32.27s call test_distributed_format/test.py::test_remove_replica 31.51s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 31.37s call test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 30.33s call test_default_compression_codec/test.py::test_default_codec_single 29.14s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 26.74s call test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 24.93s call test_dictionaries_dependency_xml/test.py::test_get_data 23.45s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 22.83s setup test_distributed_format/test.py::test_remove_replica 22.06s setup test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 21.82s setup test_access_control_on_cluster/test.py::test_access_control_on_cluster 21.75s call test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 21.40s call test_distributed_default_database/test.py::test_query 21.28s setup test_catboost_evaluate/test.py::testAmazonModelManyRows 20.93s call test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 20.92s call test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 20.73s call test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 20.55s call test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 20.19s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 20.06s teardown test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 19.34s call test_config_yaml_full/test.py::test_yaml_full_conf 19.19s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 18.74s setup test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 18.49s setup test_always_fetch_merged/test.py::test_replica_always_download 18.31s call test_dictionaries_postgresql/test.py::test_invalidate_query 17.97s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 17.94s setup test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 17.53s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 17.41s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 17.08s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 16.99s teardown test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 16.56s setup test_broken_part_during_merge/test.py::test_merge_and_part_corruption 16.48s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 16.39s call test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 16.29s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 15.87s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 15.66s setup test_backup_restore_keeper_map/test.py::test_on_cluster[0] 15.54s setup test_dictionaries_dependency_xml/test.py::test_dependent_tables 15.30s call test_catboost_evaluate/test.py::testAmazonModelManyRows 14.81s call test_config_decryption/test_wrong_settings.py::test_invalid_chars 14.40s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 14.34s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 13.89s call test_catboost_evaluate/test.py::testRecoveryAfterCrash 13.78s call test_config_decryption/test_wrong_settings.py::test_no_encryption_key 13.77s call test_config_decryption/test_wrong_settings.py::test_subnodes 13.56s setup test_create_query_constraints/test.py::test_create_query_const_constraints 13.32s setup test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 12.93s call test_config_decryption/test_wrong_settings.py::test_wrong_method 12.84s teardown test_default_compression_codec/test.py::test_default_codec_single 12.31s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 11.89s setup test_async_insert_memory/test.py::test_memory_usage 11.46s call test_dictionaries_dependency_xml/test.py::test_dependent_tables 10.91s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 10.63s call test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 10.60s call test_always_fetch_merged/test.py::test_replica_always_download 9.59s call test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 9.46s setup test_default_compression_codec/test.py::test_default_codec_for_compact_parts 9.04s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 9.02s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 8.73s call test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 8.49s call test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 8.36s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 8.03s call test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 7.95s teardown test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 7.75s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 7.31s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 7.21s setup test_config_corresponding_root/test.py::test_work 7.12s call test_default_compression_codec/test.py::test_default_codec_multiple 6.84s teardown test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 6.81s teardown test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 6.32s call test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 5.87s teardown test_always_fetch_merged/test.py::test_replica_always_download 5.68s teardown test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 5.49s call test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 5.49s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 5.32s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 5.31s call test_create_query_constraints/test.py::test_create_query_minmax_constraints 5.19s teardown test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 5.08s teardown test_async_insert_memory/test.py::test_memory_usage 4.88s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 4.85s teardown test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 4.71s teardown test_create_query_constraints/test.py::test_create_query_minmax_constraints 4.56s call test_access_control_on_cluster/test.py::test_access_control_on_cluster 4.55s teardown test_backward_compatibility/test_functions.py::test_string_functions 4.52s teardown test_backup_restore_keeper_map/test.py::test_on_cluster[1] 4.34s teardown test_broken_part_during_merge/test.py::test_merge_and_part_corruption 4.12s call test_broken_part_during_merge/test.py::test_merge_and_part_corruption 3.95s teardown test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 3.87s call test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 3.73s call test_catboost_evaluate/test.py::testModelUpdate 3.34s call test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 3.11s call test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 2.86s call test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 2.78s teardown test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 2.74s call test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 2.62s call test_create_query_constraints/test.py::test_create_query_const_constraints 2.57s call test_catboost_evaluate/test.py::testOnNullableFeatures 2.41s call test_default_compression_codec/test.py::test_default_codec_for_compact_parts 2.31s call test_catboost_evaluate/test.py::testNonConstantFeatures 2.25s call test_dictionaries_postgresql/test.py::test_load_dictionaries 1.88s call test_catboost_evaluate/test.py::testModelPathIsNotAConstString 1.75s call test_access_control_on_cluster/test.py::test_grant_all_on_cluster 1.64s teardown test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 1.57s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 1.52s teardown test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 1.41s call test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 1.41s call test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 1.40s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 1.36s call test_catboost_evaluate/test.py::testInvalidModelPath 1.35s call test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 1.29s call test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 1.22s call test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.99s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.98s call test_dictionaries_postgresql/test.py::test_postgres_schema 0.96s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.91s call test_catboost_evaluate/test.py::testInvalidLibraryPath 0.90s call test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.90s call test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.88s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.83s call test_catboost_evaluate/test.py::testConstantFeatures 0.75s teardown test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.75s call test_backward_compatibility/test_functions.py::test_string_functions 0.72s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.72s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.71s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.69s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 0.66s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.65s call test_dictionaries_postgresql/test.py::test_bad_configuration 0.64s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.64s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.63s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.34s call test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.05s setup test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.01s teardown test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 0.01s setup test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 0.00s teardown test_catboost_evaluate/test.py::testAmazonModelManyRows 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s setup test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.00s teardown test_distributed_format/test.py::test_remove_replica 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s teardown test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 0.00s teardown test_config_yaml_full/test.py::test_yaml_full_conf 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.00s teardown test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s teardown test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 0.00s setup test_dictionaries_postgresql/test.py::test_bad_configuration 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s setup test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s teardown test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 0.00s setup test_config_yaml_full/test.py::test_yaml_full_conf 0.00s setup test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 0.00s setup test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 0.00s setup test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s teardown test_config_corresponding_root/test.py::test_work 0.00s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 0.00s setup test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 0.00s teardown test_backup_restore_keeper_map/test.py::test_on_cluster[0] 0.00s setup test_backup_restore_keeper_map/test.py::test_on_cluster[1] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s teardown test_backward_compatibility/test_functions.py::test_aggregate_states 0.00s teardown test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s setup test_dictionaries_dependency_xml/test.py::test_get_data 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 0.00s teardown test_distributed_default_database/test.py::test_query 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 0.00s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s setup test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 0.00s setup test_backward_compatibility/test_functions.py::test_string_functions 0.00s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 0.00s teardown test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 0.00s teardown test_dictionaries_dependency_xml/test.py::test_dependent_tables 0.00s setup test_catboost_evaluate/test.py::testNonConstantFeatures 0.00s setup test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 0.00s teardown test_database_delta/test.py::test_complex_table_schema 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s teardown test_default_compression_codec/test.py::test_default_codec_for_compact_parts 0.00s setup test_distributed_default_database/test.py::test_query 0.00s teardown test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s teardown test_catboost_evaluate/test.py::testRecoveryAfterCrash 0.00s teardown test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s setup test_catboost_evaluate/test.py::testInvalidLibraryPath 0.00s setup test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.00s teardown test_access_control_on_cluster/test.py::test_access_control_on_cluster 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s teardown test_database_delta/test.py::test_multiple_schemes_tables 0.00s setup test_catboost_evaluate/test.py::testModelPathIsNotAConstString 0.00s setup test_catboost_evaluate/test.py::testInvalidModelPath 0.00s setup test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 0.00s setup test_catboost_evaluate/test.py::testOnNullableFeatures 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.00s teardown test_catboost_evaluate/test.py::testModelUpdate 0.00s teardown test_dictionaries_dependency_xml/test.py::test_get_data 0.00s setup test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 0.00s teardown test_default_compression_codec/test.py::test_default_codec_multiple 0.00s teardown test_catboost_evaluate/test.py::testModelPathIsNotAConstString 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s call test_config_corresponding_root/test.py::test_work 0.00s setup test_catboost_evaluate/test.py::testModelUpdate 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s teardown test_catboost_evaluate/test.py::testOnNullableFeatures 0.00s setup test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s teardown test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 0.00s setup test_create_query_constraints/test.py::test_create_query_minmax_constraints 0.00s teardown test_catboost_evaluate/test.py::testConstantFeatures 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.00s setup test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 0.00s teardown test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 0.00s setup test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s setup test_dictionaries_postgresql/test.py::test_invalidate_query 0.00s teardown test_create_query_constraints/test.py::test_create_query_const_constraints 0.00s setup test_default_compression_codec/test.py::test_default_codec_multiple 0.00s teardown test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.00s teardown test_catboost_evaluate/test.py::testNonConstantFeatures 0.00s teardown test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s setup test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.00s teardown test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.00s teardown test_catboost_evaluate/test.py::testInvalidModelPath 0.00s setup test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s teardown test_dictionaries_postgresql/test.py::test_bad_configuration 0.00s teardown test_database_delta/test.py::test_embedded_database_and_tables 0.00s teardown test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.00s setup test_catboost_evaluate/test.py::testConstantFeatures 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_schema 0.00s teardown test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.00s setup test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 0.00s setup test_dictionaries_postgresql/test.py::test_load_dictionaries 0.00s setup test_default_compression_codec/test.py::test_default_codec_single 0.00s setup test_catboost_evaluate/test.py::testRecoveryAfterCrash 0.00s setup test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s teardown test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.00s setup test_database_delta/test.py::test_multiple_schemes_tables 0.00s setup test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_schema 0.00s teardown test_dictionaries_postgresql/test.py::test_invalidate_query 0.00s setup test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 0.00s setup test_database_delta/test.py::test_embedded_database_and_tables 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s teardown test_catboost_evaluate/test.py::testInvalidLibraryPath 0.00s teardown test_dictionaries_postgresql/test.py::test_load_dictionaries 0.00s teardown test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh =========================== short test summary info ============================ ERROR test_database_delta/test.py::test_complex_table_schema - Failed: Timeou... ERROR test_database_delta/test.py::test_embedded_database_and_tables - Failed... ERROR test_database_delta/test.py::test_multiple_schemes_tables - Failed: Tim... PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] PASSED test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect PASSED test_dictionaries_postgresql/test.py::test_bad_configuration PASSED test_catboost_evaluate/test.py::testAmazonModelManyRows PASSED test_dictionaries_postgresql/test.py::test_dictionary_with_replicas PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies PASSED test_catboost_evaluate/test.py::testAmazonModelSingleRow PASSED test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString PASSED test_catboost_evaluate/test.py::testConstantFeatures PASSED test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] PASSED test_catboost_evaluate/test.py::testInvalidLibraryPath PASSED test_config_decryption/test_wrong_settings.py::test_subnodes PASSED test_catboost_evaluate/test.py::testInvalidModelPath PASSED test_catboost_evaluate/test.py::testModelPathIsNotAConstString PASSED test_catboost_evaluate/test.py::testModelUpdate PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] PASSED test_default_compression_codec/test.py::test_default_codec_for_compact_parts PASSED test_catboost_evaluate/test.py::testNonConstantFeatures PASSED test_catboost_evaluate/test.py::testOnLowCardinalityFeatures PASSED test_catboost_evaluate/test.py::testOnNullableFeatures PASSED test_distributed_format/test.py::test_remove_replica PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method PASSED test_dictionaries_postgresql/test.py::test_invalidate_query PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes PASSED test_default_compression_codec/test.py::test_default_codec_multiple PASSED test_dictionaries_postgresql/test.py::test_load_dictionaries PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] PASSED test_dictionaries_postgresql/test.py::test_named_collection_from_ddl PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key PASSED test_dictionaries_postgresql/test.py::test_postgres_schema PASSED test_dictionaries_postgresql/test.py::test_predefined_connection_configuration PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] PASSED test_catboost_evaluate/test.py::testRecoveryAfterCrash PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] PASSED test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh PASSED test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] PASSED test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] PASSED test_dictionaries_dependency_xml/test.py::test_dependent_tables PASSED test_default_compression_codec/test.py::test_default_codec_single PASSED test_create_query_constraints/test.py::test_create_query_const_constraints PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints PASSED test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] PASSED test_dictionaries_dependency_xml/test.py::test_get_data PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] PASSED test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[0] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[1] PASSED test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields PASSED test_config_corresponding_root/test.py::test_work PASSED test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] PASSED test_always_fetch_merged/test.py::test_replica_always_download PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] PASSED test_distributed_default_database/test.py::test_query PASSED test_async_insert_memory/test.py::test_memory_usage PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states PASSED test_config_yaml_full/test.py::test_yaml_full_conf PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] PASSED test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability PASSED test_broken_part_during_merge/test.py::test_merge_and_part_corruption SKIPPED [1] test_backward_compatibility/test_functions.py:164: The test is slow in builds with sanitizer ============= 96 passed, 1 skipped, 3 errors in 904.16s (0:15:04) ============== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_orh80l --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff ' returned non-zero exit status 1.